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CHAPTER  I 


Introduction 

In  this  report,  we  consider  an  H^-Wke  problem  on  a  finite  horizon.  In  Chapter  2  a 
problem  with  a  restricted  performance  index  is  treated.  We  propose  a  worst-case  optimal 
controller,  whereas  the  usual  Hoo  solutions  yield  suboptimal  ones.  The  system  considered  is 
linear  time- varying  and  the  expressions  for  the  worst-case  exogenous  input  and  the  optimal 
controller  are  in  terms  of  solutions  of  two  dynamic  Riccati  equations  in  the  case  where  the 
initial  state  is  nonzero.  Also  an  expression  for  the  optimal  controller  is  obtained  in  this 
case  in  terms  of  full  state  feedback.  Since  the  procedure  to  obtain  the  optimal  controller  is 
a  noniterative  one,  the  computational  time  is  greatly  reduced.  Also,  a  novel  feature  is  the 
derivation  of  a  formula  for  the  performance  variation  of  the  optimal  controller  in  terms  of 
variations  in  the  system  matrices. 

In  Chapter  3  we  consider  a  problem  with  a  generalized  performance  index.  We  develop 
necessary  conditions  for  a  minimax  problem  involving  control  and  exogenous  inputs.  Again 
the  problem  can  be  regarded  as  a  finite  horizon  version  of  the  H0 c  optimal  cont  rol  problem. 
The  emphasis  is  on  the  synthesis  of  optimal  controllers  whereas  the  usual  H ^  methods 
give  conditions  for  the  synthesis  of  suboptimal  ones.  Feedback  controllers  are  developed 
for  the  case  of  nonzero  initial  conditions.  Also,  expressions  are  derived  for  the  variation  in 
performance  in  terms  of  system  parameter  variations.  These  linear  expressions  arc  useful 


in  the  evaluation  of  the  robustness  of  the  proposed  optimal  control  strategy. 
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CHAPTER  II 

Worst-Case  Optimal  Control  with  a  Restricted 
Performance  Criterion 

1.  Introduction 

There  are  several  recent  papers  attacking  the  Hoc  problem  from  a  state  space  point  of 
view  and  all  of  these  obtain  a  characterization  of  suboptimal  output-feedback  cont  rollers  [1- 
5].  The  suboptimal  controller  is  usually  obtained  by  solving  two  Riccati  equations.  Theie 
art  also  finite  interval  versions  of  these  solutions  and  extensions  have  been  made  to  the 
linear  time- varying  case  as  well[4,5].  The  state  space  approach  has  yielded  new  insights 
into  the  features  of  the  Ha Q  controller,  and  one  of  these  is  the  separation  of  the  control 
problem  into  a  full  state  feedback  design  and  an  observer  design. 

In  a  different  approach  taken  by  this  author[6-8],  a  measure  of  peformance  is  computed 
for  a  given  controller  and  nonlinear  programming  algorithms  are  utilized  to  find  a  controller 
that  optimizes  the  performance.  This  approach  is  suitable  for  extending  the  methodology 
to  solve  problems  involving  convex  functionaIs[9].  We  have  also  applied  the  methodology 
to  solve  model  reduction  problems[10].  One  of  the  main  advantages  of  this  approach  is 
the  quantification  of  variation  in  peformance  when  uncertainties  are  present  in  the  system 
matrices.  However,  it  is  tedious  to  compute  the  optimal  controller  in  „his  case  because  it 
requires  several  iterations. 

The  main  contribution  of  this  report  is  the  noniterative  characterization  of  the  optimal 
controller.  We  consider  a  restricted  performance  criterion  in  Chapter  2  and  a  generalized 
performance  criterion  in  Chapter  3.  The  full  state  feedback  solution  in  the  nonzero  initial 
state  case  is  in  terms  of  two  dynamic  Riccati  equations.  The  integration  of  these  equations 
is  easy  since  only  one  of  the  Riccati  equations  depends  on  the  solution  of  the  other.  Unlike 
the  usual  approaches  which  yield  suboptimal  controllers,  our  approach  yields  an  optimal 
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controller.  Thus  the  need  for  iterative  solution  methods  like  the  7-iieration  is  eliminated. 
Because  of  the  dynamic  Riccati  equations,  the  control  gain  matrix  will  be  time- varying  even 
when  the  system  matrices  are  time-invariant.  An  important  by-product  of  the  approach  is 
a  formula  for  the  variation  of  performance  in  terms  of  variations  in  the  system  matrices. 
These  variations  in  performance  are  useful  in  evaluating  the  robustness  of  the  proposed 
controller. 


2.  Problem  Formulation 

The  linear  time-varying  system  is  given  by 

x  =  A(t)x  +  B\{t)u  +  B2(t)v,  x(t0)  =  xo,  (1) 

*  -  C(t)x  +  D(t)u,  (2) 


where  x,u,  v,  and  z  represent  the  state  vector,  the  control  vector,  the  exogenous  input 
vector,  and  the  vector  to  be  controlled  respectively.  We  consider  the  minimax  problem 

min  max 

V  U 

where  R(t )  and  TT(f)  are  positive  definite  matrices  and  the  superscript  *  denotes  matrix 
or  vector  transpose.  Also  5 1  is  a  constant  positive  definite  matrix.  The  above  problem  is 
related  to  the  H problem  since  the  functional  in  (3)  represents  the  ratio  of  exogenous 
signal  energy  to  the  error  energy.  Also,  the  solution  procedure  given  in  the  following 


pySiio  +  lv'(t)R(t)v(t)dt 


sections  is  extended  in  Chapter  III  to  the  case  where  (2)  is  of  the  form  z  =  C{t).r  + 


D(t)u  +  E(t)v. 


3.  Optimal  Solutions 


T  /  X  2  U 

J(u,v)  =  - yp 


j^Si-rp  +  fJo  ty*(t)B(t)v(t)dt 
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Using  (2),  we  can  write  (4)  as 


IxJSiXo  +  ±v*(t)R(t)v(t)dt 

J{U,  V)  =  — - . 

fto  {^X*W\X  +  X*W2U  +  ^U*W3ll)  dt 


(5) 


Notice  that  the  weighting  matrices  W\,W2,  and  W3  are  time- varying. 

We  will  first  of  all  maximize  (4)  over  u  for  any  given  v(t)  ^  0.  Thus  we  need  to 


minimize 


f 

Jt0 


{\x*Wxx  +  x*W2u  +  \u*W3u}dt 


(6) 


over  u  assuming  that  v(t)  is  given.  From  the  maximum  principle[ll],  which  in  this  case  is 
also  a  sufficient  condition  for  optimality,  the  Hamiltonian  is  gi^en  by 

H  =  -{\)x*W\x  +  x*W2u  -(-  +  ip*  {A(t)x  +  Bx(t)u  -f  B2(t)v},  (7) 

Z  Z 


where  the  adjoint  variable  ip  satisfies 


dip 

dt 


(M 

dx 


=  Wxx  +  W2u  -  A* ip. 


(8) 


with 


x(t0)  =  xq ,  i/>(T)  =  0. 


Also,  setting  ^  =  0  and  assuming  that  W3  is  invertible  for  all  /  €  [<o>r], 


(9) 


u  =  W~\B*xiP  -w;x). 


(10) 


Let 


Thus  we  have 


A  =  A  -  BiW^'W;, 

B  =  BXW~'B\, 

c  =  w,  -  W2W~lW*. 

5)-0  -!)(;)*( 


Bo 


”, 


(ID 


(12) 
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with 


*(fo)  =  ^o,  HT)  =  0. 


(13) 


Let 


and 


(U) 


do) 


(1G) 


By  (10)  the  denominator  of  (5)  can  be  put  in  the  form  where  Q(t)  is  symmetric 

and  positive  semi-definite.  The  system  given  by  (12)  can  be  written  as 


c  =  M(t)(  +  N(t)v, 


(IT) 


with 


x(to)  =  xo,  4'(T)  =  0, 


and  <■  needs  w  be  soiceLed  to  minimize  the  cost 

|*o£i£o  +  f'l  %v*{t)R{t)v(t)dt 
fZ%C(t)Q(tK(t)dt  ' 

We  now  state  the  conditions  that  are  satisfied  by  an  optimal  v{t). 


(IS) 


(19) 


THEOREM  1.  Consider  the  system  given  by  ( 17)-(  19) .  If  v0 ( t )  minimizes  (19).  then  there 
exists  a  nonzero  rj(t)  =  ( p*(t)  q*(t )  )*  such  that 

^  =  ~M*t/  -  AQ(,  (20) 


where  p(t.)  and  q(t)  are  components  of  the  adjoint  vector  corresponding  to  x(t)  and  i ,'•(/) 
respectively,  such  that 

x(to)  =  xo,  V’(T)  =  0, 


p(T )  =  0,  q(t0)  =  0, 


(21) 
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where 


find 


1  j;S|Jo  +  /,' 

Sl\<  -Q(<H 


T 


A  =  inf 

V 


v0(t)  =  R~l  N*rj. 

If  in  addition  x0  ^  0,p(to)  =  5ix(^0)- 

Proof.  If  t’o (/)  minimizes  (19),  then  it  also  minimizes 

rT  ,  ,T 


(22) 


(23) 


j(v)  =  ^XqSiTo  +  ~v*Rvdt~xJ^  ^CQC  dh 


(24) 


By  the  maximum  principle[ll],  there  exists  an  adjoint  response  i]{t)  such  that  the  Hamil¬ 
tonian 

v)  =  ~\v*Rv  +  ~XCQ(  +  tf{M(  +  AH’}  (25) 

is  maximized  almost  everywhere  on  [t0,T]  by  r0(f).  Satisfaction  of  =  0  yields 

v0(t)  =  R-'N*n.  (26) 


The  adjoint  variable  r/  satisfies 


dt 


OH 

d< 


-  —A rij  -  XQC 


(27 


By  the  transversality  conditions,  we  get  the  boundary  conditions. 
Thus  we  have  a  two  point  boundary  value  problem  given  by 


□ 


with 


M  NR~XN* 
-X  Q  -M* 


x(to)  =  xo,  4'(T)  =  0, 
p(T)  =  0,  q{t0)  =  0, 


(28) 


(29) 


p(to)  =  SiT{t o)  if  x0  /  C. 

We  now  give  a  criterion  for  the  estimation  of  A.  Notice  that  A  =  min,,  max,,  ,/(»,?•) 
and  gives  a  measure  of  performance  of  the  optimal  controller  under  worst-case  conditions 
corresponding  to  r0 (t).  In  the  case,  the  evaluation  of  A  wouh1  entail  the  •)  iteration. 
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Theorem  2.  Let  A  be  the  smallest  positive  value  for  which  the  boundary  value  problem 
gr.cn  by  (28)  and  (29)  has  a  solution  (C ,  r/)  with  dt  >  0.  Then  A  is  tin'  minimum 

value  of  ( 19),  K\7/)  JS  an  optimal  pair  and  v  ==  R~ 1  N*i]  is  tin *  worst  exogenous  input. 


Proof.  It  is  clear  from  Theorem  1  that  if  i’o (t)  minimizes  (19).  then  it  satisfies  (28) 
and  (29),  with  A  being  the  minimum  value  of  (19).  Now  suppose  (C-7/)  satisfies  (2S)  and 
(29)  for  some  A.  Let  v  =  R~lN*r). 

We  have 


.r,*Si.r0+  /  v* Rv  dt  =  T*0p{t0)  +  I  ( R  1  A'*?;.  -V*?/)  dt 

J to  *  to 

=  Kp(to)+  j  (NR-'N*ipri)dt 

Jt  0 

T  1' 

=  *oP(fo)+  f  {Cn)dt-  l  (A/C. 

J  to  j  to 


h)  dt . 


Integrating  the  first  integral  in  (30)  by  parts  and  making  use  of  (29).  we  get 

r  I  r  / 

f*o 


.r*S,. r0+  f  v'Redt  =  \[  CQ(dt. 
Jtn  Jt0 


(30) 


(31  ) 


Thus,  the  cost  associated  with  v  is  A.  Hence,  if  (C-d)  a  solution  of  the  boundary  value 
problem  given  by  (28)  and  (29)  for  the  smallest  parameter  A  >  0.  then  A  is  the  optimal 
value  and  (C-7/)  is  an  optimal  pair.  □ 

Note  that  the  boundary  value  problem  ( 28 )-( 29 )  has  a  solution  with  a  nonvanishing 
denominator  for  (19)  for  at  most  a  countably  infinite  values  of  A.  Theorem  2  gives  a 
sufficient  condition  for  an  exogenous  input  to  be  optimal.  Thus.  Theorems  1  and  2  give  a 
complete  characterization  of  the  worst-case  exogenous  input. 


4.  Computation  of  A 

In  this  section,  we  consider  the  boundary  value  problem  given  by  (2S)  and  (29)  as 
suniing  that  .r(t0)  f  0.  Analogous  theory  can  be  developed  in  case  ,r( i  —  0.  Making  use  of 


NADC-91 005-60 


the  transition  matrix,  the  solution  of  (28)  can  he  expressed  as 


0n(Mo)  0i2(t,to)  6\ 

02l(L^o)  <r2‘l{Uto)  (plz(tJu)  024  (Lb)) 
031  (Mo)  <t>32{Uto)  033(bD  0  31  (Mo) 

04i(Mo)  <t>-n(t,to)  <Pi3(t,to)  044  (b  U) )  / 


(  AU ,)\ 
'.'(hi) 

1  P(U))  , 
\q(to)/ 


(32) 


The  boundary  conditions  given  by  (29)  yield 

(  02l(jb,to)  +  ^23(T,to)Sl  $22(T,ta) 

\<*>3\{T,t0)  +  033  (Tf  t0)Si  032  (T,  1 0  ) 


•r(b>) 

v''(t0) 


=  0. 


Let 


^  _  (  021  +  023 -S' 1  022  \ 

V  031  +  033  ■S'l  032  / 


(33) 


(34) 


In  view  of  (33)  and  (28)-(29),  we  have  det(0(T.  fn))  =  0  if  and  only  if  the  solution  ((,-'/' 
of  ( 28 )- ( 29 )  is  not  identically  zero.  Thus,  we  need  the  least  positive  A  which  makes 
det  (0(T,  t0 ))  =  0  and  the  denominator  of  (19)  positive.  This  can  be  obtained  by  doing  a 
search  with  A  over  an  interval  on  which  there  is  a  change  in  the  sign  of  the  determinant. 

We  found  the  following  algorithm  to  be  numerically  more  stable  since  numbers  of 
lesser  magnitude  are  involved  in  the  computation  of  the  transition  matrices  in  (35).  We 
have 


(C(T)\ 


\n(to )/ 


(35) 


Let 


*-'{T,Z±±) 


and 


A" 

S 1  2 

63 

(id 

61 

(,22 

^23 

6l 

^31 

( 32 

(33 

31 

'011 

^42 

013 

0n  > 

v\  1 

,/12 

J/13 

l'u  \ 

V21 

>'22 

l'  23 

P  24  1 

iy3 1 

1'32 

Pi  3 

Pm  I 

"  1 1 

l/  42 

;/43 

Pi  4  / 

(36) 


■i>CAA.u)  = 


Making  use  of  ]>(f 0)  =  5i.r(fo),<7(^o)  =  V’(T’)  =  p{T)  —  0,  we  have 

A* 


(37) 


£2 1  £24 


(T)\  = 


6.  61  j\q(T)J 
Un  Ui/ 


/  l/\  1  +  f/13‘5l  *'12 

P21  +  »'23«f>l  J/22  (  ^(hlA 

Pll  +  P33  Si  I '32  j  \V'(ta)  ) 

\  l'.\\  +  1'i S ]  t'.f2 


(38) 
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The  above  equation  has  a  nontrivial  solution  if  and  only  if 


det 


(in 

64 

^11  + 

U\2 

£21 

64 

V2\  +  ^23 

v22 

S3 1 

£34 

^31  +  ^33  Si 

V32 

\£tl 

£44 

1^41  +  n43Si 

V42 

0. 


Thus,  we  need  the  least  positive  A  which  makes  the  above  determinant  zero. 


(39) 


5.  Solution  in  Terms  of  Riccati  Equations 

We  now  give  the  optimal  solution  in  terms  of  solutions  of  two  dynamic  Riccati  equa¬ 
tions  in  the  case  where  ^  0. 


Pn  Pi 
P21  P22 


THEOREM  3.  Let  P  =  (  V1  V.12  )  be  the  solution  of  the  initial  value  problem 


P  +  PM  +  M*P  +  PNR~  N* P  - \ ■  A Q  =  0, 

P«o)=(S0'  J). 

If  x(t0)  0,  let  Z  be  the  solution  of  the  dynamic  Riccati  equation 


(40) 


(41) 


Z  +  Z(A  +  B2R-lB;Pn)  +  A*Z  +  Z(B  +  B2R-1B;Pi2)Z-C  =  0,  Z(T)  =  0.  (42 


Then  the  worst-case  exogenous  input  is  given  by 


v  —  R  1  BZiPn  +  Pi2Z)x, 


(43) 


and  the  worst-case  optimal  controller  is 

u  =  W~l{B]Z  -  W*)x.  (44) 

Proof.  Letting  //  =  P(  in  (28),  we  get  (40).  From  (26)  the  worst-case  exogenous  input 
is  v  =  R~l N* PC,.  If  x(to)  0,  letting  ip  =  Zx,  we  get  v  =  R~l  B^iPn  +  P\2Z)x.  Also, 
equations  (12)  and  (13)  yield  (42).  From  (10),  we  get  the  worst-case  optimal  controller 
given  by  (44).  □ 
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Note  that  the  worst-case  optimal  control  given  by  (44)  has  time- varying  feedback  gain 
even  when  the  linear  system  is  time-invariant  because  of  the  presence  of  Z(t). 

6.  Performance  Robustness 

In  this  section  we  develop  a  formula  for  the  variation  of  A  when  there  are  parameter 
variations  in  the  system  matrices.  Note  that  this  expression  for  the  variation  in  A  takes 
into  account  the  corresponding  variations  in  the  optimal  controller  and  the  worst-exogenous 
input.  Usually  when  a  controller  is  synthesized  with  respect  to  the  nominal  values  of  system 
matrices,  its  gains  do  not  change  with  parameter  variations.  Hence,  later  on  in  this  section 
we  will  derive  an  expression  for  the  variation  in  A  assuming  that  there  is  no  variation  of 
the  optimal  gain  matrix. 

For  this  consider  (1)  and  (2).  Let  fi  denote  the  variation  in  A  for  elemental  variations 
SA,  SB i ,  SB2,SC,  and  6D  in  the  matrices  A,  B\ ,  B2,  C,  and  D.  From  equations  (28)  and  (29) 
of  Section  3,  we  have  the  following  boundary  value  problem  given  by 

c  =  M(  +  NR~1N*t1,  (45) 

*7  =  -AQC  -  M*r],  (46) 

with 

x(t0 )  =  x0,t/’(T)  =  0, 

p(T)  —  0,  q{to)  =  0,  (47) 

p(M  =  Six(to)  if  x0  t ^  0. 

To  simplify  the  derivation,  let  <5M,  6N,  and  SQ  be  the  variations  in  M,  N,  and  Q  owing  to 
the  variations  6A,8Bi,8B2,8C,  and  SD  We  now  derive  an  expression  for  /x  in  terms  of  the 
variations  flVf,  SN ,  and  SQ. 

Let  £j  and  t)\  represent  variations  in  £  and  r]  owing  to  8M,8N ,  and  SQ.  Let  the  corre¬ 
sponding  variation  in  A  be  denoted  by  //.  We  have  the  following  set  of  equations  that  are 
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satisfied  by  Ci  and  rji : 

Ci  =  MCi  +  NR~1N*rll  +  SMC  +  ( SNR~'N *  +  NR-'Wfr,  (48) 

m  =  -AQCi  -  M*m  -  (A 8Q  +  (iQ)(  -  SM'rj,  (49) 


with 


xi(t0)  =  Xio,ipi(T)  =  0, 
Pi(T)  =  0,qi(to)  —  0, 


(50) 


Pi(to)  =  •S'iXio  if  x0  ±  0. 

Note  that  the  subscript  1  of  a  variable  in  (50)  denotes  the  corresponding  variation  of  that 
variable. 


THEOREM  4.  The  variation  p  in  performance  is  given  by 


p  = 


+  2 C(M’l  +  ’ i'(6NR-'N'  +  NR~'W)ri)  dt 


J„CQ<dt 


Proof.  From  (49),  we  get 

rT  rT 


f  Cm  dt  =  —  f  {ACQCi  +  CM*m  +  C*(A«?  +  pQ)C  +  CWri)  dt. 
Jto  dt  0 

Integrating  the  left  side  of  (52)  by  parts  and  making  use  of  (45)  and  (50),  we  get 

T  T 

^oS'i^ioT  [  V* N R  ]  N*V\  dt  =  A  f  C*QCi  dt 

Jto  Jto 

+  f  C(*SQ  +  pQ)(dt+  f  C6M*T)dt. 

Jto  j  to 

By  (46),  the  first  integral  on  the  right  side  of  (53)  is  written  as 

A  fTCQCi  dt  =  —  [T(f,  +  M*7/)*Ci  dt. 

J  to  J  to 

An  integration  by  parts  and  equations  (48)  and  (50)  yield 


A  /  CQCidt  =  x*0SlxU)+  f  q* N R~l N*rji  dt  +  f  rj * 

j  to  J  to  j  to 


SM(  dt 


+ 


/  CiWR-1 

Jto 


N*  +  NR-' 6N')hdt. 


(51) 


(52) 


(53) 


(54) 


(55) 
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Substituting  (55)  in  (53)  and  simplifying,  we  get  (51).  □ 

Since  \i  given  by  (51)  is  linear  in  the  elemental  variations  &4,  8B\ ,  <$Z?2,  <C,  and  8D, 
at  least  in  the  time- invariant  case  the  worst  degradation  in  performance  can  be  easily 
obtained  once  the  range  of  uncertainty  of  the  parameters  is  known. 

Now  we  consider  the  case  where  xo  ^  0.  Assume  that  the  state  feedback  controller 
is  determined  by  the  nominal  system  matrices  and  is  fixed.  We  derive  a  formula  for  the 
variation  of  A  under  these  conditions.  Since  A  gives  a  measure  of  performance  of  the 
optimal  controller  under  worst-case  conditions,  we  can  get  an  idea  of  the  degradation  in 
performance  owing  to  parameter  variations.  Equation  (44)  is  written  as 


u  =  W~\B\Z  -  w;)x  =  K{t)x,  (56) 

where  K(t)  is  now  fixed.  Let  A  —  A  +  B\K  and  W  =  (C  4-  DK)*W(C  f  DK).  Equation 
(1)  can  be  written  as 


x  =  A{t)  -f-  B2(t)v, 


with  v  chosen  to  minimize 

|xq5ix0  +  J^\v*Rvdt 
ftl  2 x*Wxdt 

Note  that 

.  +  f?0  \v*Rvdt 

A  -  mm - ™ - - - . 

”  /to  l2x*Wxdt 

The  above  minimization  problem  yields  the  two-point  boundary  value  problem 


A  B2R~'B*2\(x\ 
\0)  \~W  - A *  )\0J' 


x(t0)  =  0 ,0(to)  =  S\Xo,/3(T)  =  0, 


(57) 

(58) 

(59) 

(60) 
(61) 


where  0  is  the  adjoint  variable  and  the  worst  exogenous  input  v  =  R  XB20-  Let  B  — 
B2R~]  B2. 
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Let  8A,  SB,  and  8W  be  the  variations  in  A ,  B,  and  W  corresponding  to  SA ,  6B\ ,  8B2,8C, 
and  SD.  Note  that  since  K(t)  is  fixed,  M  =  8A-\-8B\ K.  Let  the  variation  in  A  be  now  denoted 
by  fi.  Utilizing  a  similar  analysis  as  in  the  derivation  of  (51),  we  can  get 


H  = 


-  j£{A x*8Wx  +  2x*6A*0  +  0*6B/3}  dt 
x*W  x  dt 


(02) 


Since  fl  is  linear  in  the  variations,  the  worst  degradation  in  the  performance  of  the 
optimal  controller  can  be  easily  computed  in  the  time-invariant  case.  The  worst  value  of 
/}  gives  an  idea  of  the  measure  of  performance  robustness  of  the  optimal  controll^’' 


7.  An  Example 

In  order  to  illustrate  the  basic  theory,  we  will  work  out  a  simple  example.  The  system 
is  described  by  the  equation 


x  =  —x  +  u  +  v,  x(0)  =  £0  7^  0, 
and  the  objective  is  to  choose  u  and  v  such  that 

hxl  +  fo  h2(lt 


mm  max 


"  “  foHx2  +  u2)dt 


is  attained. 


First  of  all,  minimizing  |(x2  +  u2)dt  over  u(t)  for  a  given  v(t),  we  get 

(*0=(i  0(^)+(°)'’’ 

U  =  tp, 

x(0)  =  ^0,0(1)  =  o, 

where  /  is  the  adjoint  variable.  Now  we  need  to  choose  v  to  minimize 

5*o  +  fo  W  dt 


foi(x2  +  ^)dt 


(63) 


(64) 


(65) 

(66) 
(67) 


(68) 
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Let  A  be  the  minimum  value  of  (68).  Denoting  the  adjoint  variables  associated  with  x  and 
0  by  ?/ 1  and  rj2  respectively,  we  get 


%  =  -\  x  +  v'-ri2. 

(69) 

dt  =  ^  ^  ~ 

(70) 

r/^O)  =  xo,t?2(0)  =  0,q*(l)  =  0, 

(71) 

v  —  771 . 

(72) 

Thus,  we  have 


r1 

1 

1 

°  \ 

(  x\ 

<l> 

1 

1 

0 

0 

xl>  1 

-A 

0 

1 

-1 

7/1  1 

\r)2) 

V  0 

-A 

-1 

wJ 

x(0)  =  x0,ip(  1)  =  0,  7^(0)  =  x0,t}2(0)  =  0,  ^(l)  =  0. 


(73) 

(74) 


According  to  the  theory  of  Section  3,  A  is  the  least  positive  value  for  which  the  boundary 
value  problem  (73)-(74)  has  a  nonzero  solution. 

Let  <j>  be  the  transition  matrix  of  the  system  given  by  (73)  at  t  =  1.  Solving  (73)  and 
employing  the  boundary  conditions  at  t  =  1,  we  get 


0  =  {Z\)  =  FW(m)- 


where 


F(  A)  = 


<^21  +  <t>  23  <^22 


(75) 


(76) 


<^31  T  <f>33  <f>32 

Thus,  we  need  the  first  positive  A  which  makes  det(F(A))  =  0.  This  value  of  A  is  2.  It  can 
be  easily  shown  that  with  the  initial  condition  ar(0)  =  0,  the  value  of  A  would  have  been 
6.1159.  The  case  of  u  =  cx,x( 0)  =  0,  where  c  is  a  constant  gain  is  solved  in  [7]  and  in  this 
case  A  =  5.6837. 

Now  the  Riccati  equations  in  Theorem  3  can  be  easily  solved  to  obtain  the  worst-case 
optimal  controller  and  the  worst-case  exogenous  input. 
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8.  Conclusions 

In  this  chaper  we  presented  a  solution  to  the  finite  interval  worst-case  state  feedback 
controller  in  terms  of  solutions  of  two  dynamic  Riccati  equations.  These  equations  are  easy 
to  solve  since  only  one  of  the  two  equations  is  dependent  on  the  solution  of  the  other,  the 
procedure  yields  optimal  solutions  instead  of  suboptimal  ones  normally  obtained  by  JToo 
methods.  Also,  an  expression  is  derived  for  the  degradation  in  performance  of  the  optimal 
controller  in  terms  of  parameter  variations. 
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CHAPTER  III 

Worst-Case  Optimal  Control  with  a  Generalized 
Performance  Criterion 

l.  Introduction 

Recent  state  space  approaches  characterize  suboptimal  H0 0  controllers  in  terms  of 
solutions  of  two  Riccati  equations[l-5].  Although  there  have  been  extensions  of  the  state 
space  approach  to  cases  involving  nonzero  initial  conditions[3],  time- varying  systems[4,5], 
and  control  on  a  finite  horizon[5],  there  have  been  virtually  no  attempts  to  characterize 
the  optimal  solutions. 

In  a  different  approach  taken  by  this  author [6-9],  the  controller  ir  assumed  to  be 
in  feedback  form  and  a  performance  measure  is  evaluated  for  any  given  controller.  Then 
nonlinear  programs  can  be  utilized  to  select  a  controller  which  maximizes  the  performance. 
Although  this  approach  yielded  satisfactory  controllers  in  several  practical  cases,  it  also 
consumed  excessive  amounts  of  computational  time.  In  [10]  this  approach  is  successfully 
employed  to  solve  a  model  reduction  problem. 

In  this  chapter  we  consider  a  worst-case  optimal  control  problem  with  a  generalized 
performance  criterion.  We  employ  a  new  approach  by  considering  the  underlying  minimax 
problem  and  treating  the  adjoint  variables  associated  with  the  maximization  problem  as 
state  variables  for  the  minimization  problem.  The  associated  performance  index  is  com¬ 
puted  in  terms  of  the  least  positive  value  for  which  a  certain  boundary  value  problem  has 
a  nontrivial  solution.  A  simple  criterion  for  the  evaluation  of  the  performance  index  is 
given  in  Section  4.  In  the  case,  the  evaluation  of  the  performance  index  would  entail 
the  7-iteration.  Our  technique  is  noniterative  and  hence  is  computationally  efficient.  Also, 
expressions  for  the  optimal  feedback  controller  for  the  nonzero  initial  condition  case  are 
developed  in  terms  of  solutions  of  two  dynamic  Riccat  i  equations.  These  Riccati  equations 
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are  easy  to  solve  since  only  one  equation  depends  on  the  solution  of  the  other.  In  Section  G 
expressions  for  the  variation  in  performance  of  the  optimal  controller  are  derived  in  terms 
of  variations  in  the  system  matrices.  Utilizing  these  expressions,  the  degradation  in  the 
performance  of  the  optimal  controller  owing  to  variations  in  the  system  matrices  can  be 
easily  computed.  The  worst  degradation  in  the  performance  gives  an  idea  of  the  robustness 
of  the  proposed  controller. 


2.  Problem  Formulation 

The  linear  time-varying  system  is  given  by 

x  =  A(t)x  +  Bi(t)u  +  B2(t)v,  x(t0)  —  x  o,  (1) 

z  =  C{t)x  +  D(t)u  -f  E(t)v,  (2) 

where  x,u,v,  and  z  represent  the  state  vector,  the  control  vector,  the  exogenous  input 

vector,  and  the  vector  to  be  controlled  respectively.  We  consider  the  minimax  problem 

fzJSjXo  +  SZ \v*{t)R{t)v 

mm  max - ~ - 51 - 

'  “  t)w(i)z(t)dt 

where  R(t)  and  W(t)  are  positive  definite  matrices  and  the  superscript  *  denotes  matrix 
or  vector  transpose.  Also  Si  is  a  constant  positive  definite  matrix.  The  above  problem 
is  related  to  the  H problem  since  the  functional  in  (3)  represents  the  ratio  of  exoge¬ 
nous  signal  energy  to  the  error  energy.  Problems  where  j0  ^  0  have  been  considered  in 
[3].  However,  [3]  characterizes  suboptimal  solutions,  whereas  we  characterize  the  optimal 
solutions  in  this  report. 


(t)  dt 

- ,  (3) 


Let 


3.  Optimal  Solutions 


J(u, V ) 


^XqSiXo  +  fT  ^v*(t)R(t)v(t)dt 

/,y  mo  * 


(4) 
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Us’ng  (2),  we  can  write  (4)  as 


ix*SiX0  +  j\ro  ±v*(t)R{t)v(t)dt 


J(u, v)  = 


,  (5) 


Ito{hx*Wix  +  x*W2u  +  \ u*W3u  +  x*W4v  +  | v*W5v  +  u*W6v}  dt 
Notice  that  the  weighting  matrices  Wi ,  W2 ,  W3 ,  W4 ,  W5  and  W$  are  time- varying. 

We  will  first  of  all  maximize  (4)  over  u  for  any  given  v(t )  ^  0.  Thus  we  need  to 


minimize 


f7  i  1  1 

/  {-x*Wix  +  x*W2u  +  -u*W$u  +  x*W4v  +  -v*W$v  +  u*W%v]  dt  (6) 

Jt0  2  2  2 

over  u  assuming  that  v(t)  is  given.  From  the  maximum  principlefll],  which  in  this  case  is 
also  a  sufficient  condition  for  optimality,  the  Hamiltonian  is  given  by 

H  =  -{\x*Wxx  +  x'W2u+\u*Wzu  +  xmWAv+\v*Wsv  +  umWsv}  + 

Z  m  z 


tp*{A(t)x  +  Bi(t)u  4-  B2(t)v}, 


(7) 


where  the  adjoint  variable  satisfies 

~  =  =  Wxx  +  W2u  +  WAv  -  TV,  (8) 

at  ox 

with 

x(t0)  =  xq ,  =  0.  (9) 

Also,  setting  =  0  and  assuming  that  W3  is  invertible  for  all  t  €  [to, T], 

U  =  W-\B*xx!>  -  w;x  -  W6u).  (10) 

Let 

a  =  a-b1w3~1w;, 

B  =  BXW~'B\, 

c  =  Wi  - w2w3lw;,  (ii) 

G\  =B2-BlW3-1W6, 
g2  =  w4  -  w2w3'w6. 
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Thus  we  have 


with 


x(t0)  -  To ,  -  0. 


(13) 


Let 


and 


(14) 


(15) 


N 


G  i 

Gi 


(1C) 


By  (10)  the  denominator  of  (5)  can  be  put  in  the  form  |(*QiC  +  CQ2V  +  hv*Q3v,  wliei 


nr 


Qi{t)  and  Qz(t)  are  symmetric  and  positive  semi-definite.  The  system  given  by  (12)  can 
be  written  as 


c  =  M(0C  +  JV(0*>, 


(IT) 


with 

x(to)  =  *0,  4'{T)  =  0,  (IS) 

and  v  needs  to  be  selected  to  minimize  the  cost 

I^oSiXo  +  ±v*(t)R(t)v(t)dt 

nrr  "  •  (  1 J  } 

Ji,  <K*(0Qi(0C(0  +  CQ2V  +  \v'Q3v)  dt 

We  now  state  the  conditions  that  are  satisfied  by  an  optimal  v(t). 

Theorem  1.  Consider  the  system  given  by  (17 )-( 19) .  Assume  that  R  —  A Q3  is  invertible' 
for  nil  t,  €  [to,T].  If  vo(t)  minimizes  (19) ,  then  there  exists  a  nonzero  i](t)  =  ( p*(t. )  q*(t)  )* 

such  that 

~  =  -M*i1-\Qx(-\Q2v,  (20) 
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where  p(t)  and  q(t)  are  components  of  the  adjoint  vector  corresponding  to  x(t)  and  V'(t) 


respectively,  such  that 


where 


*(M  =  ?o,  4'(T)  =  0, 
p{T)  =  0,  q{t0)  -  0, 


+  J^v*Rvdt 

A  =  inf  - - - . 

'  ft o  { +  CQ2V  +  %vmQ3v)  dt 


v0(t)  =  (R  -  \Q3)-'  {\Q*2C  +  N'p) 
If  in  addition  x0  7^  0 ,p(t0)  =  Six{t0). 

Proof.  If  Vo(t)  minimizes  (19),  then  it  also  minimizes 


j(v)&\xiS,ro  + 


Jt  \eRvdt-\j\±cQ>i;  +  CQ2v  +  \e(hv}dt.  (24) 


By  the  maximum  principle[ll],  there  exists  an  adjoint  response  i]{t)  such  that  the  Hamil¬ 
tonian 

H(ThC'v)  —  —~v*Rv  +  A{  -  C*QiC  +  (*Q2v  +  +  ?/*  { M(  +  Aij  (25) 

is  maximized  almost  everywhere  on  [f0,T]  by  v0(t).  Satisfaction  of  =  0  yields 


v0(t)  =  (R-\Q3)-'{\Q-2(  +  N*v}. 


The  adjoint  variable  r/  satisfies 


dq  _  dH 
dt  0( 


—  -M*q  -  AQi(  -  \Q2v. 


By  the  transversality  conditions,  we  get  the  boundary  conditions. 


M  =  M  +  XN(R- \Q3)~xQ*2, 
N  =  N(R  -  \Q3)~'  Nm , 
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L  =  -\Qi  -  \2Q2(R  -  ^Qi)~lQ*2- 


(30) 


Thus  we  have  a  two  point  boundary  value  problem  given  by 


(31) 


with 

r{t0)  =  -ro,  t{T)  =  0, 

p(T)  =  0,  q(to)  =  0,  (32) 

p(t0)  =  5i.r(/„)  if  jo  /  0. 

We  now  giv<'  a  criterion  for  the  estimation  of  A.  Notice  that  A  =  min,,  max,,  J(u.r) 
and  gives  a  measure  of  performance  of  the  optimal  controller  under  worst-case  conditions 
corresponding  to  v0(t).  In  the  H0 0  case,  the  evaluation  of  A  would  entail  the  7-iteration. 


Til  KOI?  KM  2.  Let  A  he  the  smallest  positive  value  for  which  the  boundary  value  problem 
given  by  (31)  and  (32)  has  a  solution  (( ,?/)  with  //0{yC*QiC  +  C *Q-2V  +  ^e*Q:xv<lt  >  0. 
when'  r  =  (/?  —  AC/))-1  {AC/JC  +  Ar  *  -  Then  A  is  the  minimum  value  of  { 19),  ((,'. '/ )  is  an 
optimal  pair  and  r  =  (R  —  A  Qi)~]  { AC/^C  +  A'*?/}  is  the  worst  exogenous  inj>ut. 


Proof.  It  is  clear  from  Theorem  1  that  if  r0(/)  minimizes  (19).  then  it  satisfies  (31)  and 
(32).  with  A  being  the  minimum  value  of  (19).  Now  suppose  ((),?/)  satisfies  (31)  and  (32) 
for  some  A.  Let  r  =  ( R  —  AC/i  )-1  {AC/JC  +  A’*;/}.  In  the  following  equations  (  .  )  denote-, 
an  inner  product. 

We  have 


rj-%  rj-,  y  . 

[  {(R-\Q3)vt»)<h=  [  (AQK.”}'"  h  /  (A*?/,  e 

j  to  J to  J to 


)dt. 


(33) 


By  equation  (17),  the  second  integral  of  (33)  can  be  written  as 

■T  rT  rT 


f  (N*i),v)dt.=  f  (7pNv)(lt=  I  (//,(  + A/C) d(. 

J  (  0  J  (q  **  1 0 


(31) 
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An  integration  by  parts  and  equations  (20)  and  (29)  yield 


f  (??,(  +  MQdt.  =  -Xo5i.ro  +  A  f  (QiCC)dt-f  A  /  (C .Q2v)tlt. 

J t o  J  to  J  t (1 


( 3d 


Substituting  (35)  in  (33),  we  get 

. T 
,  to 


T  T 

S\T0  +  f  v'Rvdt  =  A  f  {CQi C  +  2C*g2tt  +  f*g3r}  fit. 

Jto  Jto 


(30) 


Thus,  the  cost  associated  with  t>  is  A.  Hence,  if  ((,*,  ?/)  is  a  nontrivial  solution  of  the  bound<  ry 
value  problem  given  by  (31)  and  (32)  for  the  smallest  parameter  A  >  0.  then  A  is  the  optimal 
value  and  ((,',?/)  is  an  optimal  pair.  □ 

Note  that  the  boundary  value  problem  (31  )-(32 )  has  a  solution  with  a  nonvanishing 
denominator  for  (ID)  for  at  most  a  countably  infinite  values  of  A.  Theorem  2  gives  a 
sufficient  condition  for  an  exogenous  input  to  be  optimal.  Thus.  Theorems  ]  and  2  give  a 
complete  characterization  of  the  worst-case  exogenous  input. 


4.  Computation  of  A 


In  this  section,  we  consider  the  boundary  value  problem  given  by  (31)  and  ( 32  i  a^ 
smiling  that  .r(bi)  ^  0.  Analogous  theory  can  be  developed  in  case  ,r o  —  0.  Making  u>e  of 
tin-  transition  matrix,  the  solution  of  (31)  can  be  expressed  as 


(Af)\ 

/0  Il(b0)  0  12(0  0)  1 3  (  ^  ■>  ^  0  )  01t(Ob))\ 

/•Ob t)  \ 

0(0 

021  (00)  022(0  0)  023(0  0  )  02  1  (  0  0  ) 

u(bi ) 

pi  0 

W)/ 

03l(OO)  032  ( 0  0  )  03.3(00)  0.3l(OO) 

Wll(OO)  042  (  0  0  )  013(00)  0-l.|(OO)/ 

/>(  bi) 

'  '/(O)  / 

Tli<'  boundary  conditions  given  by  (32)  yield 


( 3 1  i 


/  d>2\(Tito)  +  <t>2^(T,to)S^  022  (TJq)\  /  .r(/())  A 

V  cMT,/0)  +  <^i.i(T,/o)5i  032(T,  to)/  \0(bi)/ 


Let 


(  <t> 21  +  023 -S' 1 

\  03  1  +  033 


(39) 
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In  view  of  (38)  and  (31)-(32),  we  have  det(<^(T,  to))  =  0  if  and  only  if  the  solution  ((,7/) 
of  (31)-(32)  is  not  identically  zero.  Thus,  we  need  the  least  positive  A  which  makes 
det(<^(T, to))  —  0  and  the  denominator  of  (19)  positive.  This  can  be  obtained  by  doing  a 
search  with  A  over  an  interval  on  which  there  is  a  change  in  the  sign  of  the  determinant. 

We  found  the  following  algorithm  to  be  numerically  more  stable  since  numbers  of 
lesser  magnitude  are  involved  in  the  computation  of  the  transition  matrices  in  (38).  We 


have 


Let 


fC(T)\  __ 

W  T)J  ~ 


C(M 

7?(*0) 


and 


(in 

£l2 

63 

£l4^ 

£22 

£23 

£24 

: 

1 

£32 

£33 

£34 

V&i 

£42 

&3 

£44  ' 

/^ii 

1^12 

1713 

1714  \ 

j  ^21 

I/22 

*723 

1724  I 

1  ^31 

^32 

7733 

I734  1 

\I/41 

1^42 

1743 

174  4  / 

Making  use  of  p(t0)  =  Six(t0),q(t0)  =  i/>(T)  =  p(T)  =  0,  we  have 


£ll 

£l4  \ 

/I'll  +  I7j  3  S\ 

7'l2  \ 

£21 

£24 

1721  +  7723  5] 

7722 

£31 

64 

U  (T))~ 

7731  +  7733-Si 

7'32 

£41 

£44  / 

V 1/41  +  V43S] 

7742  / 

•K*o) 

t/’(t0) 


The  above  equation  has  a  nontrivial  solution  if  and  only  if 


det 


/£» 

£14 

>7 1 1  +  77]  3  -5l 

77]  2 

£21 

£24 

7721  +  7723*5'] 

7722 

£31 

£34 

7731  +  7/33  S] 

7732 

^£41 

£44 

7741  +  7743Si 

7742 

=  0. 


Thus,  we  need  the  least  positive  A  which  makes  the  above  determinant  zero. 


(38) 


(41) 


(42) 


(43) 


(44) 


5.  Solution  in  Terms  of  Riccati  Equations 

We  now  give  the  optimal  solution  in  terms  of  solutions  of  two  dynamic  Riccati  equa¬ 
tions  in  the  case  where  i0  ^  0. 
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THEOREM  3.  Let  P  be  the  solution  of  the  initial  value  problem 

P  +  PM  +  M*P  +  PNP-L  =  0,  (45) 

P(M=(S0-  “)•  («) 

Let 

e  =  (R-  \Q3)-\\Q*2  +  N*P)  =  (0J  02  )  ,  (47) 

where  9 j  and  9i  have  equal  number  of  columns.  If  x(t0)  ^  0,  let  Z  be  the  solution  of  the 
dynamic  Riccati  equation 

Z  T  Z(A  +  G\9i)  +  (A*  —  G292)Z  T  Z{B  4-  G\02)Z  —  C  —  G29\  =  0,  Z[T)  =  0.  (4S) 

Then  the  worst-case  exogenous  input  is  given  by 

v  =  ($i  +02Z)x,  (49) 

and  the  worst-case  optimal  controller  is 

u  =,  W3~'  ((B*  -  WG02)Z  -  W;  -  We0l  )x.  (50) 

Proof.  Letting  q  —  P(  in  (31),  we  get  (45).  From  (26)  the  worst-case  exogenous  input 
is  v  =  (R—  \Q3 )— 1  {AQ2  +  N*P)C,.  If  x(to)  ^  0,  letting  xf  =  Zx ,  and  utilizing  (47),  we  got. 
v  =  (0 1  +  92Z)x.  Also,  equations  (12)  and  (13)  yield  (48).  From  (10),  we  get  the  worst-case 
optimal  controller  given  by  (50).  □ 

Note  that  the  worst-case  optimal  control  given  by  (50)  has  time- varying  feedback  gain 
even  when  the  linear  system  is  time-invariant. 

6.  Performance  Robustness 

In  this  section  we  develop  a  formula  for  the  variation  of  A  when  there  are  parameter 
variations  in  the  system  matrices.  Note  that  this  expression  for  the  variation  in  A  takes 
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into  account  the  corresponding  variations  in  the  optimal  controller  and  the  worst-exogenous 
input.  Usually  when  a  controller  is  synthesized  with  respect  to  the  nominal  values  of  system 
matrices,  its  gains  do  not  change  with  parameter  variations.  Hence,  later  on  in  this  section 
we  will  derive  an  expression  for  the  variation  in  A  assuming  that  there  is  no  variation  of 
the  optimal  gain  matrix. 

For  this  consider  (1)  and  (2).  Let  p  denote  the  variation  in  A  for  elemental  variations 
6A,  SB  1 , 6B2,8C,  SD,  and  8E  in  the  matrices  A,  B\ ,  Z?2,  C,  D  and  E.  From  equations  (31) 
and  (32)  of  Section  3,  we  have  the  following  boundary  value  problem  given  by 


C  =  Af  C  4-  Nr), 

(51) 

r,  =  L(-M*r1, 

(52) 

with 

x(t0)  =  x0,il>(T)  =  0, 

p(T)  =  0,  q{to)  =  0,  (53) 

p(t0)  =  Six(t0)  if  xq  ±  0. 

Let  8M,  6N ,  and  8L  be  the  variations  in  M,  N,  and  L  owing  to  the  variations  &4,  bD\ ,  SB-2, 
8C ,  6D,  and  6E.  Let  the  corresponding  variation  in  A  be  denoted  by  p. 

Let  A  =  (R  —  AQ3)-1.  From  (28)-(30),  we  get 


8M  —  I\  4-  /x/2, 

(54) 

8N  =  J\  4"  P  J 2 1 

(55) 

6L  =  A 1  +  pA.2i 

(50) 

where 


h=6M  +  XNA8Q2  +  XSNAQ;  +  X2NA8Q3AQ*2,  (57) 

h  =  NAQ*2  +  XNAQ3AQ*3,  (58) 
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Ji  =  NA8N* +6NAN*  +  \NA8Q3AN*,  (59) 

J2  =  NAQ3AN*,  (GO) 

A'!  =  -A 8QX  -  \2{6Q2AQ*2  +  Q2A8Q *)  -  A3Q2A<5Q3AQ*,  (Gl) 

I<2  =  -Qi  -  2\Q2AQ*2  -  \2Q2AQ3AQ*  (G2) 


For  the  sake  of  simplicity,  we  now  derive  an  expression  for  p  in  terms  of  the  variations 
SM,  6N,  6Q 1 , 6Q2 ,  and  6Q3 . 

Let  Ci  and  771  represent  variations  in  (  and  77  owing  to  6M,6N,6Q\,tiQ2,  and  8Q3.  We 
have  the  following  set  of  equations  that  are  satisfied  by  Ci  and  77  1 : 

Ci  =  MCi  +  Nr/i  +  (/1  -(-  ^/2) C  +  ( J\  +  fiJ2)i],  (63) 

771  =  LCi  ~  M*ri\  +  (Ai  +  /^7f2)C  —  ( I\  +  pl2)*t],  (G4) 

with 

*i(<o)  =  x\oA'\(T)  =  0, 

Pi(T)  =  0,qi(to)  =  0,  (Go) 

Pi(*o)  =  S1X10  if  ^0  /  0. 

Note  that  the  subscript  1  of  a  variable  in  (65)  denotes  the  corresponding  variation  of  that 
variable. 


Theorem  4.  Let  v  =  A{AQ£C  +  N*r}.}  Then  the  variation  //  in  performance  is  given  by 

fT 

ft  0 


£{C*A'iC-2C*/2*r,-  17*7,17}* 


+  2(*Q2v  -f  v*Q3vj  dt 


(66) 


Proof.  From  (64),  we  get 
-T  rT 


f  Cmdt=  f  {Cki-CM*m+C(Ki+nK2X-C(h+pl2Yv}dt.  (67) 
«/ fo  J ^0 

Integrating  the  left  side  of  (67)  by  parts  and  making  use  of  (51),  (53)  and  (65),  we  get 

-XgSiXio  -  f  T]*Nrjidt=  f  (*L(]dt 
J  to  J f 0 

T  T 

+  [  C*(A'i  +  pK2)C  dt  -  f  C(h+M^dt. 

Jto  dt  0 


(68) 
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By  (52),  the  first  integral  on  the  right  side  of  (58)  is  written  as 


fjy  rp 

/  CLCidi=  [  (t?  +  M*7?)*Ci  dt. 
Jtn  Jtn 


An  integration  by  parts  and  equations  (53),  (63)  and  (65)  yield 


[  dt  —  -x^SiXio-  f  dt—  j  r]*(Ii+fil2)Cdt-  f  i)*{J\+iiJ2)r]  dt.  (70) 

•J  to  J  io  J  tQ  ‘'to 

Substituting  (70)  in  (68)  and  simplifying,  we  get 

A  little  algebra  shows  that  the  denominator  of  (71)  equals  the  denominator  of  (66)  □ 

Since  n  given  by  (66)  is  linear  in  the  elemental  variations  SA ,  bB\ ,  8B2 ,  SC,  8D  and  SE. 
at  least  in  the  time-invariant  case  the  worst  degradation  in  performance  can  be  easily 
obtained  once  the  range  of  uncertainty  of  the  parameters  is  known. 

Now  we  consider  the  case  where  xo  ^  0.  Assume  that  the  state  feedback  controller 
is  determined  by  the  nominal  system  matrices  and  is  fixed.  We  derive  a  formula  for  the 
variation  of  A  under  these  conditions.  Since  A  gives  a  measure  of  performance  of  the 
optimal  controller  under  worst-case  conditions,  we  can  get  an  idea  of  the  degradation  in 
performance  owing  to  parameter  variations.  Equation  (49)  is  written  as 


u  =  -  W692)Z  -  w;  -  W§6\)x  =  K(t)x, 


where  K(t)  is  now  fixed.  Let  A  =  A  -f  B\  K.  Equation  (1)  can  be  written  as 


x  =  A(f)  -f  B2{t)v, 


with  v  chosen  to  minimize 


jxJJSiXo  +  ftg  \v*Rvdt 
ft^i  +  x*W2v  +  \v*W3v)  dt 
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Note  that 

.  |xS5ix0  +  f£±v*Rv dt 

A  =  min  — ~ - 1 - - ; - . 

V  fto{^x*Wix  +  x*W2v  +  ^v*W3v}  dt 

Let  Q  =  (R-AWs)-1  and 


M  =  A  +  AB2flW2*, 


N  = 

l  =  -a wx  -  a2w2qw;. 


(75) 


(7G) 

(77) 

(78) 


The  above  minimization  problem  yields  the  two-point  boundary  value  problem 


(;)-(!  -£■)(;) 


x(t0)  =  0,/?(t0)  =  S\Xo,  (3(T)  =  0, 


(79) 

(SO) 


where  /?  is  the  adjoint  variable  and  the  worst  exogenous  input  v  =  f l{B2/3  -f  A W2x). 

Let  6A,6B2,8iV1,8lV2,  and  6W3  be  the  variations  in  A,  J52,  W\ ,  W2,  and  IT3  corre¬ 
sponding  to  SA,6Bi ,  8B2,  SC ,  6D ,  and  6E.  Note  that  since  K(t )  is  fixed.  8A  =  8A  +  SBiK. 
Let  the  variation  in  A  be  now  denoted  by  ji.  Utilizing  a  similar  analysis  as  in  the  derivation 
of  (66),  we  can  get 


^  -  rT 


fto  {x'lux  -  2x*I*/3  -  0*  Jx0)  dt 


Jto  {x*Wxx  -fi  2x*W2v  +  v*W3v)  dt 


(si: 


where 


h 

Ji 

Ki 


sA  +  a  {B2nsw;  +  6b2siw;}  +  A2B2nw3nw;, 

B2Q,6B2  +  6B2UB 2*  +  AB2S18W3SIB*2, 

-AWi  -  a 2{s\v2nw*  +  iu2fw;}  -  A3w2nmr3nw; 


(82) 

(S3) 

(84) 


Since  ji  is  linear  in  the  variations,  the  worst  degradation  in  the  performance  of  the 
optimal  controller  can  be  easily  computed  in  the  time-invariant,  case.  The  worst  value  of 
ji  gives  an  idea  of  the  measure  of  performance  robustness  of  the  optimal  controller. 
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7.  An  Example 

In  order  to  illustrate  the  basic  theory,  we  will  work  out  a  simple  example.  The  system 


is  described  by  the  equation 


x  =  —x  +  u  +  v,  x(0 )  =  x0  ^  0, 


and  the  objective  is  to  choose  u  and  v  such  that 


\xo  +  Jo  W  dt 

mm  max  —r-z - — -  — — — 

v  u  fo  \(x2  +  u2  +  v2)dt 


is  attained. 


First  of  all,  minimizing  Jj  |(x2  -f  u2  +  v2)dt  over  u(t)  for  a  given  v(t),  we  get 


0)-(v ;  )(;)+©«. 


u  =  xj>, 


x(0)  =  x0,^(l)  =  0, 


where  ip  is  the  adjoint  variable.  Now  we  need  to  choose  v  to  minimize 

5xo  +  Jr!  \v2  dt 

2_o - J o_2 - -  (QO) 

Jo  2^x2  +  V>2  +  V2)dt 

Let  A  be  the  minimum  value  of  (90).  Denoting  the  adjoint  variables  associated  with  x  and 
ip  by  r?1  and  r?2  respectively,  we  get 

<tL  =  -\X  +  Tj'-Tl2,  (91) 

=  -AV>  -  j?1  -  T]2,  (92) 

^'(O)  =  x0,r?2(0)  =  0, 771  ( 1 )  =  0,  (93) 


1  -  A 
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Thus,  we  have 


/  x.\ 

/ 

V1 

\r)V 

\ 

1 

-A 


1 

1 

0 


(95) 


z(0)  =  z0,t/>(l)  =  O^^O)  =  x0,r)2(  0)  =  0,^(1)  =  0.  (9G) 

According  to  the  theory  of  Section  3,  A  is  the  least  positive  value  for  which  the  boundary 
value  problem  (95)-(96)  has  a  nonzero  solution. 

Let  <j>  be  the  transition  matrix  of  the  system  given  by  (95)  at  t  =  1.  Solving  (95)  and 
employing  the  boundary  conditions  at  t  =  1,  we  get 

'  wm  \ 

(97) 


0=("'(i))  =  F<A) 


/*(0)\ 


where 


+  <t>  23  ^22 
+  <f>33  <t>  32 


(98) 


F<A)  =  (t 

Thus,  we  need  the  first  positive  A  which  makes  det(F(\))  —  0.  This  value  of  A  is  0.8276. 
It  can  be  easily  shown  that  with  the  initial  condition  x(0)  =  0,  the  value  of  A  would  have 
been  0.85947.  This  of  course  is  the  first  positive  A  which  makes 

detft22  M=0.  (90) 

\  <P 32  Y33  J 

Now  the  Riccati  equations  in  Theorem  3  can  be  easily  solved  to  obtain  the  worst-case 
optimal  convioller  and  the  worst-case  exogenous  input. 


8.  Conclusions 

In  this  chapter  we  presented  a  solution  to  the  finite  interval  worst-case  state  feedback 
controller  in  terms  of  solutions  of  two  dynamic  Riccati  equations.  These  equations  are  easy 
to  solve  since  only  one  of  the  two  equations  is  dependent  on  the  solution  of  the  other,  the 
procedure  yields  optimal  solutions  instead  of  suboptimal  ones  normally  obtained  by 
methods.  Also,  an  expression  is  derived  for  the  degradation  in  performance  of  the  optimal 
controller  in  terms  of  parameter  variations. 
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